TITLE OF THE INVENTION 
IMAGE SENSING ELEMENT, IMAGE SENSING APPARATUS, AND 
INFORMATION PROCESSING APPARATUS 



FIELD OF THE INVENTION 

The present invention relates to an image sensing 
element, image sensing apparatus, and information 
processing apparatus and, more particularly, to an image 
sensing element suitable for performing pupil division 
focus detection upon receiving a beam having passed 
through the pupil of, e.g., an image sensing lens, a 
camera having the image sensing element, and an 
information processing apparatus. 

BACKGROUND OF THE INVENTION 

There are several focus detection methods for 
cameras. Japanese Patent Laid-Open Nos . 55-111928 and 
58-24105 disclose apparatuses for performing pupil 
division focus detection by using a two-dimensional 
sensor in which microlenses are formed on the respective 
pixels of the sensor. 

Canon Inc. has proposed in Japanese Patent Laid- 
Open No. 2001-124984 an apparatus for performing pupil 
division focus detection by using an image sensor (image 
sensing element) used in a digital still camera. 

Fig. 12 is a view for explaining the principle of 
a method of performing pupil division focus detection by 



using an image sensor, which is disclosed in Japanese 
Patent Laid-Open No. 2001-124984. An image sensor 10 is 
arranged on the prospective imaging plane of an image 
sensing lens 5. One pixel of the image sensor 10 is made 
5 up of two light-receiving portions 13a and 13b. The 

light-receiving portions 13a and 13b are so arranged as 
to be almost conjugate to the pupil of the image sensing 
lens 5 through a microlens 11 formed on the image 
sensing lens side. 

10 The light-receiving portion 13a receives a beam 

having passed through a predetermined lower region of 
the image sensing lens 5 in Fig. 12. The light-receiving 
portion 13b receives a beam having passed through a 
predetermined upper region of the image sensing lens 5 

15 in Fig. 12. In detecting the focus, signals from the 
light-receiving portions 13a and 13b of pixels are 
independently read out. These signals form two images of 
beams having passed through different positions on the 
pupil of the image sensing lens 5. Japanese Patent 

20 Laid-Open No. 5-127074 discloses a method of detecting a 
focus by using two images generated by beams having 
passed through different regions on the pupil of an 
image sensing lens. The image sensor disclosed in 
Japanese Patent Laid-Open No. 2001-124 984 outputs the 

25 sum of an output from the light-receiving portion 13a of 
one pixel and an output from its light-receiving portion 
13b in general photography. 
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Japanese Patent Publication No. 5-61610 discloses 
a method of controlling exposure of a focus detection 
sensor in detecting a focus. To monitor the light 
quantity incident on the focus detection sensor, the 
5 focus detection sensor of this reference has monitoring 
pixels which are interposed between pixels for 
generating a focus detection image and monitor the light 
quantity incident on the sensor. Outputs from the 
monitoring pixels control the accumulation time of the 

10 focus detection pixel and the like. 

The image sensor for performing pupil division 
focus detection is constituted such that a 
light-receiving portion in one pixel of the image sensor 
is divided into two regions. The light-receiving 

15 sensitivity is low in the region between these 
light-receiving portions. 

Figs. 13A and 13B are views showing a beam 
incident on one pixel of the image sensor in general 
photography. In Figs. 13A and 13B, reference numerals 

20 13a and 13b denote two divided light-receiving portions. 
The light-receiving sensitivity is low in the region 
between these light-receiving portions. The dotted 
circuit in Fig. 13A is an incident beam when the stop of 
the image sensing lens is in a full aperture state. When 

25 the stop is in a full aperture state, a beam incident on 
the low-sensitivity region is less than beams incident 
on the light-receiving portions 13a and 13b. The degree 
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of decrease in image sensor output is small, hardly 
influencing exposure control. 

If the stop of the image sensing lens is stopped 
down, the ratio of a beam incident on the 
5 low-sensitivity region to beams incident on the 

light-receiving portions 13a and 13b increases, as shown 
in Fig. 13B. The degree of decrease in image sensor 
output increases. When photometry is done with the image 
sensing lens being in a full aperture state and the stop 
10 of the image sensing lens is stopped down in accordance 
^ with the photometry result, the image sensor output 

ft decreases more than the stopping-down effect. 

O The light-receiving portion of the image sensor 

f].| and the pupil of the image sensing lens are almost 

15 conjugate to each other through the microlens. The pupil 
of the image sensing lens and the light-receiving 
portion of the sensor have the same relationship as that 
shown in Fig. 13A on the pupil plane of the image 
sensing lens. Beams incident on the light-receiving 
20 portions 13a and 13b of the image sensor have a 

semicircular pupil shape (portion where the pupil 
(circle represented by the dotted line) of the image 
sensing lens and the light-receiving portions 
(rectangles represented by solid lines) overlap each 
25 other) . This shape is different between the 

light-receiving portions 13a and 13b (mirror image 
relationship) . 
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Fig. 14 shows the image sensor outputs of one 
white line image generated by the light-receiving 
portions 13a and 13b of the image sensor. An image a in 
Fig. 14 is an image formed by outputs from the 
light-receiving portions 13a of pixels. An image b in 
Fig. 14 is an image formed by outputs from the 
light-receiving portions 13b of pixels. In this image 
sensor, the similarity between the two images a and b is 
low. Even correlation calculation using the two images 
produces a calculation result error, generating a focus 
detection error. 

To detect the focus state of the image sensing 
lens, monitoring pixels for determining the charge 
accumulation time of the pixels and the like are 
desirably arranged near pixels for acquiring a focus 
detection image, and a high-contrast focus detection 
image is desirably acquired. However, the above image 
sensor does not incorporate any monitoring pixels for 
determining the charge accumulation time of the pixels 
and the like in order to detect the focus state of the 
image sensing lens. In the image sensor, the 
accumulation time and the like are controlled based on 
an output from a separate photometry sensor. A 
high-contrast image is not always obtained. 



SUMMARY OF THE INVENTION 
The present invention has been made in 



consideration of the above situation, and has as its 
object to realize high-precision exposure control 
regardless of the F-number of an image sensing lens in 
photography. 

5 It is a secondary object of the present invention 

to enable increasing coincidence between two images 
subjected to correlation calculation in focus detection 
r and increasing the focus detection precision. 

;| It is another secondary object of the present 

10 invention to allow obtaining an image sensed under a 
proper exposure as an image subjected to correlation 

P 

11 calculation in focus detection. 

tl The first aspect of the present invention relates 

y to an image sensing element for sensing an image formed 

;;| 15 by an image sensing lens, comprising a pixel which 

includes a first light-receiving region that includes a 
region where a principal ray having passed through the 
image sensing lens is incident, and a second 
light-receiving region that does not include the region 
20 where the principal ray having passed through the image 
sensing lens is incident. 

According to a preferred aspect of the present 
invention, the second light-receiving region preferably 
includes two divided light-receiving regions, and the 
25 two divided light-receiving regions are preferably so 

arranged as to sandwich the first light-receiving region. 
The two divided light-receiving regions are suitable to 



at least detect a focus state of the image sensing lens, 
or suitable to detect a focus state of the image sensing 
lens and photograph an object. The first light-receiving 
region is suitable to determine a time during which 
charges are accumulated in the second light-receiving 
region. 

According to another preferred aspect of the 
present invention, it is preferable that one of the two 
divided light-receiving regions receives a beam from one 
of two predetermined regions on a pupil of the image 
sensing lens and the other of the two divided 
light-receiving regions receives a beam from the other 
of the two predetermined regions on the pupil of the 
image sensing lens, the two predetermined regions being 
regions that sandwich an optical axis. 

According to still another preferred aspect of the 
present invention, the image sensing element preferably 
further comprises a function of individually outputting 
charges accumulated in the first light-receiving region 
and charges accumulated in the two divided 
light-receiving regions, and a function of outputting a 
sum of charges accumulated in the first light-receiving 
region and charges accumulated in the two divided 
light-receiving regions. 

According to still another preferred aspect of the 
present invention, an interval between the two divided 
light-receiving regions is preferably relatively narrow 



at a center of the first light-receiving region and 
relatively wide at two ends of the first light-receiving 
region. Alternatively, the first light-receiving region 
is preferably relatively narrow at a center and 
relatively wide at two ends. Alternatively, the first 
light-receiving region is preferably narrower than a 
width of each of the two divided light-receiving regions 
at a center, and wider than the width of each of the two 
divided light-receiving regions at two ends. 

According to still another preferred aspect of the 
present invention, the pixel preferably has an axially 
symmetrical structure. 

According to still another preferred aspect of the 
present invention, a region formed from the first and 
second light-receiving regions preferably has a 
substantially regular polygonal shape. Alternatively, a 
region formed from the first and second light-receiving 
regions preferably has a shape substantially obtained by 
cutting off each corner of a square. 

According to still another preferred aspect of the 
present invention, the image sensing element preferably 
further comprises a microlens which causes two divided 
light-receiving regions to respectively receive beams 
from two predetermined regions on a pupil of the image 
sensing lens, the two predetermined regions being 
regions that sandwich an optical axis. 

According to still another preferred aspect of the 



present invention, the second light-receiving region is 
preferably used to at least detect a focus state of the 
image sensing lens. 

According to still another preferred aspect of the 
present invention, the second light-receiving region is 
preferably used to detect a focus state of the image 
sensing lens and photograph an object. 

According to still another preferred aspect of the 
present invention, the first light-receiving region is 
preferably used to determine a time during which charges 
are accumulated in the second light-receiving region. 

According to still another preferred aspect of the 
present invention, the image sensing element preferably 
further comprises a microlens on a region formed from 
the first and second light-receiving regions. 

The second aspect of the present invention relates 
to an image sensing apparatus comprising any one of the 
above-described image sensing elements, and a control 
unit for detecting a focus state of the image sensing 
lens by using the second light-receiving region of the 
image sensing element, and performing focus adjustment. 

This image sensing apparatus can be implemented as, 
e.g., a digital still camera, a digital video camera, a 
hybrid device of these cameras, or a camera having 
another function in addition to the functions of these 
cameras . 

According to still another preferred aspect of the 



present invention, the control unit preferably controls 
photographing operation so as to photograph an object by 
using the second light-receiving region. 

According to still another preferred aspect of the 
5 present invention, the control unit preferably 

determines, by using the first light-receiving region, a 
time during which charges are accumulated in the second 
light-receiving region. 

According to still another preferred aspect of the 

10 present invention, the control unit preferably controls 
a time during which charges are accumulated in the 
second light-receiving region, in accordance with an 
exposure amount of the first light-receiving region of 
the image sensing element in focus adjustment. 

15 According to still another preferred aspect of the 

present invention, the control unit preferably 
individually reads out charges accumulated in the first 
light-receiving region and charges accumulated in the 
second light-receiving region in focus adjustment, and 

20 reads out a sum of charges accumulated in the first 

light-receiving region and charges accumulated in the 
two divided light-receiving regions in photography. 

The third aspect of the present invention relates 
to an information processing apparatus comprising the 

25 above-described image sensing element or image sensing 
apparatus. The information processing apparatus can be 
implemented as, e.g., a portable terminal such as a 



portable telephone or portable computer. 

Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 
the same or similar parts throughout the figures thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The accompanying drawings, which are incorporated 
in and constitute a part of the specification, 
illustrate embodiments of the invention and, together 
with the description, serve to explain the principles of 
the invention. 

Fig. 1 is a view showing the structure of a camera 
according to a preferred embodiment of the present 
invention; 

Fig. 2 is a circuit diagram showing an image 
sensor according to the preferred embodiment of the 
present invention; 

Fig. 3 is a sectional view showing the image 
sensor according to the preferred embodiment of the 
present invention; 

Fig. 4 is a plan view showing the image sensor 
according to the preferred embodiment of the present 
invention; 

Fig. 5 is a schematic view showing a photographing 
optical system according to the preferred embodiment of 
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the present invention; 

Figs. 6A and 6B are plan views showing the image 
sensor according to the preferred embodiment of the 
present invention; 

Fig. 7 is a graph showing an image sensor output 
according to the preferred embodiment of the present 
invention; 

Figs. 8A and 8B are timing charts of the image 
sensor according to the preferred embodiment of the 
present invention; 

Fig. 9 is a flow chart showing the operation of 
the camera according to the preferred embodiment of the 
present invention; 

Fig. 10 is a flow chart showing focus detection 
operation of the camera according to the preferred 
embodiment of the present invention; 

Fig. 11 is a plan view showing the image sensor 
according to the preferred embodiment of the present 
invention; 

Fig. 12 is a view for explaining the focus 
detection principle; 

Figs. 13A and 13B are plan views showing an image 
sensor; and 

Fig. 14 is a graph showing an image sensor output. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
A preferred embodiment of the present invention 
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will be described below with reference to the 
accompanying drawings . 

Figs. 1 to 11 are views showing the preferred 
embodiment of the present invention. Fig. 1 is a view 
showing the structure of a digital still camera having 
an image sensing element (to also be referred to as an 
image sensor hereinafter) according to the preferred 
embodiment of the present invention. Fig. 2 is a circuit 
diagram showing the image sensor. Fig. 3 is a sectional 
view showing one pixel of the image sensor. Figs. 4, 6A, 
and 6B are plan views showing one pixel of the image 
sensor. Fig. 5 is a schematic view showing a 
photographing optical system. Fig. 7 is a graph for 
explaining an image sensor output. Figs. 8A and 8B are 
timing charts. Fig. 9 is a flow chart for explaining the 
operation of the digital still camera. Fig. 10 is a flow 
chart showing focus detection operation. Fig. 11 is a 
plan view showing the image sensor. 

In Fig. 1, reference numeral 10 denotes an image 
sensor according to the preferred embodiment of the 
present invention. The image sensor 10 is arranged on 
the prospective imaging plane of an image sensing lens 5 
(5a, 5b) of a digital still camera 1. The digital still 
camera 1 comprises a CPU 20 for controlling the overall 
camera, an image sensor control circuit 21 for driving 
and controlling the image sensor 10, an image processing 
circuit 24 for processing an image signal sensed by the 
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image sensor 10, a liquid crystal display element 9 for 
displaying a sensed image, a liquid crystal display 
element driving circuit 25 for driving the liquid 
crystal display element 9, an eyepiece lens 3 for 
5 allowing the photographer to observe an object image 
displayed on the liquid crystal display element 9, a 
memory circuit 22 for recording an image sensed by the 
h image sensor 10, an interface circuit 23 for outputting 

J;;? an image processed by the image processing circuit 24 

fj i! ! 10 outside the camera, and a manipulation switch SW2 for 

** allowing the photographer to designate recording of a 

•f^ photographed image. The memory circuit 22 also records 

unique information of the image sensing lens. 
fU The image sensing lens 5 has the two lenses 5a and 

m 

f£| 15 5b in Fig. 1 for convenience. The image sensing lens 5 



Hi 



is typically comprised of many lenses. The image sensing 
lens 5 is adjusted to an in-focus state by an image 
sensing lens driving mechanism 26 on the basis of focus 
adjustment information sent from the CPU 20. Reference 
2 0 numeral 30 denotes a stop device which is stopped down 
to a predetermined F-number by a stop driving mechanism 
27. 

Fig. 2 is a schematic circuit diagram showing the 
image sensor 10 according to the preferred embodiment of 
25 the present invention. Fig. 2 shows a two-dimensional 
area sensor with 2x2 pixels for convenience. In 
practice, the image sensor 10 is made up of several 
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million pixels. 

In Fig. 2, reference numerals 101a, 101b, and 101c 
denote photoelectric conversion portions of 
photoelectric conversion elements each formed from a MOS 
5 transistor gate and a depletion layer below the gate; 
102a, 102b, and 102c, photogates; 103a, 103b, and 103c, 
MOS transistors serving as transfer switches; 104, a 
resetting MOS transistor; 105, a MOS transistor serving 
as a source follower amplifier; 106, a MOS transistor 

10 serving as a horizontal selection switch; 107, a load 

MOS transistor by source follower connection; 108, a MOS 
transistor for transferring a dark output; 10 9, a MOS 
transistor for transferring a bright output; 110, a 
capacitor CTN for accumulating dark outputs; 111, a 

15 capacitor CTS for accumulating bright outputs; 112, a 
horizontal transfer MOS transistor; 113, a MOS 
transistor for resetting a horizontal output line; 114, 
a differential output amplifier; 115, a horizontal 
scanning circuit; and 116, a vertical scanning circuit. 

20 These components constitute the image sensor control 
circuit 21 in Fig. 1. 

Fig. 3 is a sectional view showing a pixel portion. 
In Fig. 3, reference numeral 117 denotes a P-well; 118, 
an Si0 2 film serving as the gate insulating film of the 

25 MOS; 119, a poly-Si electrode serving as a photogate 
electrode; 120, a transfer gate for transferring 
photocharges accumulated below the photogate electrode 



to a floating diffusion portion (to also be referred to 
as an FD portion hereinafter) 121; 129, a color filter; 
and 130, a microlens. The microlens 130 is formed with a 
shape at a position that makes the pupil of the image 
5 sensing lens 5 and the photoelectric conversion portion 
of the image sensor 10 be almost conjugate to each other. 

Fig. 4 is a plan view showing one pixel of the 
image sensor 10. One pixel of the image sensor 10 has 
three light-receiving regions 119a, 119b, and 119c 

10 segmented by poly-Si electrodes. Transfer gates 120a, 

120b, and 120c are respectively arranged at the ends of 
the light-receiving portions, and can transfer 
photocharges generated in these light-receiving regions 
to the FD portion 121. The region between the 

15 light-receiving regions 119a and 119c and the region 

between the light-receiving regions 119b and 119c are so 
constructed as to attain low light-receiving 
sensitivities. A circuit in Fig. 4 represents the region 
where the microlens 130 is formed. 

20 Fig. 5 is a schematic view showing the 

photographing optical system of the digital still camera 
1 according to the preferred embodiment of the present 
invention. Fig. 5 shows a principal ray 40 incident on 
each pixel of the image sensor 10. The principal ray 40 

25 is a beam having passed through the center of the 

aperture of the stop device 30. Each pixel of the image 
sensor 10 is constructed such that the principal ray 40 



passes through the microlens 130 and color filter 12 9 
and then reaches the light-receiving region 119c of each 
pixel . 

Figs . 6A and 6B are views showing a beam incident 
5 on one pixel of the image sensor 10. The microlens 130 
on the image sensor 10 is formed with a shape at a 
position that makes the pupil of the image sensing lens 
5 and the photoelectric conversion portion of the image 
sensor 10 be almost conjugate to each other. A beam 

10 having almost the same shape as the stop shape formed by 
the stop device 30 of the image sensing lens 5 enters 
the pixel of the image sensor 10. In general photography, 
the transfer gates 120a, 120b, and 120c shown in Fig. 4 
operate to add outputs corresponding to beams incident 

15 on the three light-receiving regions 119a, 119b, and 
119c, outputting the sum outside the sensor. 

The dotted circle in Fig. 6A represents an 
incident beam when the stop of the image sensing lens 5 
is in a full aperture state. When the stop device 30 is 

20 in a full aperture state, a beam incident on the 

low-sensitivity region is less than beams incident on 
the light-receiving portions 119a, 119b, and 119c. The 
degree of decrease in sensor output is small, rarely 
influencing exposure control. 

25 If the stop of the stop device 30 of the image 

sensing lens 5 is stopped down, most of the incident 
beam enters the light-receiving region 119c positioned 



at the center of one pixel, as shown in Fig. 6B. The 
ratio of a beam incident on the low-sensitivity region 
is low. Hence, the degree of decrease in sensor output 
is small, hardly influencing exposure control. 

In this manner, the light-receiving region within 
each pixel is divided into the first light-receiving 
region 119c which receives a beam containing a principal 
ray out of photographing beams having passed through the 
stop device 30 of the image sensing lens 5, and the 
second light-receiving regions 119a and 119b which 
receive beams not containing any principal ray. Accurate 
exposure control can be executed even if the stop of the 
image sensing lens 5 is stopped down. 

In focus detection, the stop of the stop device 30 
of the image sensing lens 5 is set to a full aperture 
state. A beam incident on one pixel of the image sensor 
10 obtains a dotted shape in Fig. 6A. On one pixel of 
the image sensor 10, the central light-receiving region 
119c including a position (x in Fig. 4) where the 
principal ray of a photographing beam is incident on is 
sandwiched between the two light-receiving regions 119a 
and 119b, as shown in Fig. 4. At the center of each 
pixel, a width WcO of the light-receiving region 119c is 
set smaller than widths WaO and WbO of the two 
light-receiving regions 119a and 119b. At the end 
(peripheral portion) of each pixel, a width Wcl of the 
light-receiving region 119c is set larger than widths 



Wal and Wbl of the two light-receiving regions 119a and 
119b. As a result, a beam incident on the 
light-receiving region 119a is almost symmetrical to a 
beam incident on the light-receiving region 119b. 

Fig. 7 shows images generated by the 
light-receiving regions 119a and 119b of pixels on the 
image sensor 10 when, e.g., one white line is sensed in 
focus detection. An image a generated by the 
light-receiving regions 119a of pixels and an image b 
generated by the light-receiving regions 119b of pixels 
are similar to each other. Thus, correlation calculation 
using the two images yields a high-precision result. 
Outputs from the light-receiving regions 119a and 119b 
are separately output by individually operating the 
transfer gates 120a and 120b. 

The operation of the image sensor 10 will be 
explained with reference to the timing charts of 
Figs. 8A and 8B. 

Figs. 8A and 8B are timing charts for the 0th line 
when the image sensor 10 detects a focus. The focus 
state of the image sensing lens 5 is detected by 
conducting correlation calculation between two images 
obtained by outputs from the light-receiving regions 
119a and 119b, and calculating the shift amount (phase 
difference) between the two images. To obtain a 
high-contrast image, the accumulation times of the 
light-receiving regions 119a and 119b are set based on 
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an output from the light-receiving region 119c. 

In Fig. 8A, a monitoring output is obtained from 
the light-receiving region 119c in order to determine 
the accumulation times of the light-receiving regions 
119a and 119b. The vertical scanning circuit 116 changes 
a control pulse $L to high level at a predetermined 
timing to reset a vertical output line. The vertical 
scanning circuit 116 changes a control pulse <I>R0 to high 
level to turn on the resetting MOS transistor 104, 
removing residual electrons from the FD portion 121. The 
vertical scanning circuit 116 changes control pulses O 
PGaO, <E>PGbO, and OPGcO to high level to set the poly-Si 
electrodes 119a, 119b, and 119c of the photogates 102a, 
102b, and 102c to high level. Light having passed 
through the microlens 130, color filter 129, and 
photogate electrode 119 generates electron-hole pairs in 
the dotted depletion layer of the P-well 117. When an 
electric field of a positive pulse is applied by the 
control pulses <J>PGa0, OPGbO, and <I>PGc0, holes move 
toward the P-well, and electrons move to below the 
poly-Si electrode 119. Photocharges corresponding to the 
amount of electrons generated in accordance with the 
incident light quantity are accumulated below the 
poly-Si electrode 119. 

The vertical scanning circuit 116 changes a 
control pulse OS0 to high level to turn on the 
horizontal selection switch MOS transistor 106, thereby 
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selecting the pixel portion of the Oth line. The 
vertical scanning circuit 116 changes the control pulse 
<2>R0 to low level to stop resetting of the FD portion 121. 
Accordingly, the FD portion 121 changes to a floating 
5 state, and the MOS transistor 105 operates as a source 
follower amplifier. After a predetermined time, a 
control pulse <£>TN is changed to high level to output the 
jy, dark voltage of the FD portion 121 to the accumulation 

b 

f-'i capacitor CTN 110 by source follower operation. 

f'\ 10 To obtain a monitoring output from the 



m 



light-receiving region 119c of each pixel on the Oth 
line, the vertical scanning circuit 116 changes a 
control pulse <I>TXcO to high level to turn on the 
transfer switch MOS transistor 103c. After a 

15 predetermined time, the vertical scanning circuit 116 
changes the control pulse <&PGc0 to low level. At this 
time, the potential spread below the photogate 102c 
(photogate electrode 119) increases, and photoinduced 
carriers are transferred to the FD portion 121. Since 

20 charges from the photoelectric conversion portion 101c 

of the photodiode are transferred to the FD portion 121, 
the potential of the FD portion 121 changes in 
accordance with the light quantity. The MOS transistor 
105 as a source follower amplifier is in a floating 

25 state. A control pulse <3>TS is changed to high level to 
output the potential of the FD portion 121 to the 
accumulation capacitor CTS 111. At this time, dark 



outputs and optical outputs from pixels on a 
predetermined line are respectively accumulated in the 
accumulation capacitors CTN 110 and CTS 111. A control 
pulse <I>HC is temporarily changed to high level to turn 
on the horizontal output line resetting MOS transistor 
113, thereby resetting a horizontal output line. In the 
horizontal transfer period, the horizontal scanning 
circuit 115 outputs a scanning timing signal to the 
horizontal transfer MOS transistor 112 to output dark 
outputs and optical outputs from pixels to the 
horizontal output line. At this time, a differential 
output Vout between the accumulation capacitors CTN 110 
and CTS 111 is output from the differential output 
amplifier 114. A high-S/N signal free from any random 
noise or fixed-pattern noise of a pixel can be obtained. 

The horizontal scanning circuit 115 sequentially 
outputs scanning timing signals to the horizontal 
transfer MOS transistors 112 of respective pixels to 
obtain monitoring outputs from the pixels. 

To perform focus detection over a plurality of 
lines, the vertical scanning circuit 116 starts to 
obtain monitoring outputs from pixels on the next line. 

After monitoring outputs from a predetermined line 
subjected to focus detection are obtained, signals are 
read out from the light-receiving regions 119a and 119b 
of respective pixels for the accumulation time 
corresponding to the monitoring outputs. In this 
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embodiment, the CPU 20 weights monitoring outputs from 
the light-receiving regions 119c of respective pixels on 
the same line. The CPU 20 calculates an appropriate 
accumulation time of this line in accordance with the 
weighting result. The CPU 20 controls the vertical 
scanning circuit 116 and horizontal scanning circuit 115 
serving as image sensor control circuits so as to make 
the accumulation times of pixels equal to each other on 
the same line. 

The vertical scanning circuit 116 changes the 
control pulse <I>L to high level to reset a vertical 
output line at a timing corresponding to the set 
accumulation time. The vertical scanning circuit 116 
changes the control pulse <3>R0 to high level to turn on 
the resetting MOS transistor 104, removing residual 
electrons from the FD portion 121. 

The vertical scanning circuit 116 changes the 
control pulse OS0 to high level to turn on the 
horizontal selection switch MOS transistor 106, 
selecting the pixel portion of the 0th line. The 
vertical scanning circuit 116 changes the control pulse 
OR0 to low level to stop resetting of the FD portion 121. 
Accordingly, the FD portion 121 changes to a floating 
state, and the MOS transistor 105 operates as a source 
follower amplifier. After a predetermined time, the 
control pulse $TN is changed to high level to output the 
dark voltage of the FD portion 121 to the accumulation 
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capacitor CTN 110 by source follower operation. 

To obtain an output from the light-receiving 
region 119a of each pixel on the 0th line, the vertical 
scanning circuit 116 changes a control pulse 4>TXaO to 
high level to turn on the transfer switch MOS transistor 
103c. After a predetermined time, the vertical scanning 
circuit 116 changes the control pulse OPGaO to low level. 
At this time, the potential well spread below the 
photogate 102a (photogate electrode 119) increases, and 
photoinduced carriers are transferred to the FD portion 
121. Since charges from the photoelectric conversion 
portion 101a of the photodiode are transferred to the FD 
portion 121, the potential of the FD portion 121 changes 
in accordance with the light quantity. The MOS 
transistor 105 as a source follower amplifier is in a 
floating state. The control pulse $TS is changed to 
high level to output the potential of the FD portion 121 
to the accumulation capacitor CTS 111. At this time, 
dark outputs and optical outputs from pixels on a 
predetermined line are respectively accumulated in the 
accumulation capacitors CTN 110 and CTS 111. The control 
pulse <I>HC is temporarily changed to high level to turn 
on the horizontal output line resetting MOS transistor 
113, thereby resetting a horizontal output line. In the 
horizontal transfer period, the horizontal scanning 
circuit 115 outputs a scanning timing signal to the 
horizontal transfer MOS transistor 112 to output dark 
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outputs and optical outputs from pixels to the 
horizontal output line. At this time, the differential 
output Vout between the accumulation capacitors CTN 110 
and CTS 111 is output from the differential output 
5 amplifier 114. A high-S/N signal free from any random 
noise or fixed-pattern noise of a pixel can be obtained. 

Subsequently, an output from the light-receiving 
region 119b is obtained by the same process. 

Focus detection outputs are attained from 

10 respective pixels by sequentially supplying scanning 
timing signals to the horizontal transfer MOS 
transistors of the pixels from the horizontal scanning 
circuit 115. Fig. 7 shows outputs from the 
light-receiving regions 119a and 119b on a predetermined 

15 line. This embodiment properly controls the accumulation 
times of the focus detection light-receiving regions 
119a and 119b on the basis of a monitoring output from 
the light-receiving region 119c sandwiched between the 
focus detection light-receiving regions 119a and 119b. A 

20 high-contrast image can be obtained as a focus detection 
image, resulting in high focus detection precision. 

Fig. 8B is a timing chart for the 0th line when 
the image sensor 10 performs general image sensing. In 
general image sensing, photocharges generated in the 

25 light-receiving regions 119a, 119b, and 119c are added 
at their common FD portion 121, and the sum is output 
outside the image sensor 10. 



In Fig. 8B, the vertical scanning circuit 116 
changes the control pulse 4>L to high level at a 
predetermined timing to reset a vertical output line. 
The vertical scanning circuit 116 changes the control 
pulse $R0 to high level to turn on the resetting MOS 
transistor 104, removing residual electrons from the FD 
portion 121. The vertical scanning circuit 116 changes 
the control pulses OPGaO, <I>PGbO, and OPGcO to high 
level to set the poly-Si electrodes 119a, 119b, and 119c 
(represented by the poly-Si electrode 119 in Fig. 3 for 
illustrative convenience, but in practice the poly-Si 
electrodes 119a, 119b, and 119c are formed in 
correspondence with the photogates 102a, 102b, and 102c) 
of the photogates 102a, 102b, and 102c to high level. 
Light having passed through the microlens 130, color 
filter 129, and photogate electrode 119 generates 
electron-hole pairs in the dotted depletion layer of the 
P-well 117. When an electric field of a positive pulse 
is applied by the control pulses OPGaO, OPGbO, and <I> 
PGcO, holes move toward the P-well, and electrons move 
to below the poly-Si electrode 119. Photocharges 
corresponding to the amount of electrons generated in 
accordance with the incident light quantity are 
accumulated below the poly-Si electrode 119. 

The vertical scanning circuit 116 changes the 
control pulse OS0 to high level to turn on the 
horizontal selection switch MOS transistor 106, thereby 



selecting the pixel portion of the Oth line. The 
vertical scanning circuit 116 changes the control pulse 
OR0 to low level to stop resetting of the FD portion 121. 
Accordingly, the FD portion 121 changes to a floating 
5 state, and the MOS transistor 105 operates as a source 
follower amplifier. After a predetermined time, the 
control pulse OTN is changed to high level to output the 
dark voltage of the FD portion 121 to the accumulation 
capacitor CTN 110 by source follower operation. 

10 To obtain outputs from the light-receiving regions 

119a, 119b, and 119c of each pixel on the Oth line, the 
vertical scanning circuit 116 changes the control pulses 
OTXaO, <I>TXbO, and OTXcO to high level to turn on the 
transfer switch MOS transistors 103a, 103b, and 103c. 

15 After a predetermined time, the vertical scanning 

circuit 116 changes the control pulses $PGa0, $PGb0, 
and <J)pGc0 to low level. At this time, the potential 
spread below the photogates 102a, 102b, and 102c 
increases, and photoinduced carriers are transferred to 

20 the FD portion 121. Since charges from the photoelectric 
conversion portions 101a, 101b, and 101c of the 
photodiode are transferred to the FD portion 121, the 
potential of the FD portion 121 changes in accordance 
with the light quantity. The source follower amplifier 

25 MOS transistor 105 is in a floating state. The control 
pulse <E>TS is changed to high level to output the 
potential of the FD portion 121 to the accumulation 



capacitor CTS 111. At this time, dark outputs and 
optical outputs from pixels on a predetermined line are 
respectively accumulated in the accumulation capacitors 
CTN 110 and CTS 111. The control pulse 0>HC is 
temporarily changed to high level to turn on the 
horizontal output line resetting MOS transistor 113, 
thereby resetting a horizontal output line. In the 
horizontal transfer period, the horizontal scanning 
circuit 115 outputs a scanning timing signal to the 
horizontal transfer MOS transistor 112 to output dark 
outputs and optical outputs from pixels to the 
horizontal output line. At this time, the differential 
output Vout between the accumulation capacitors CTN 110 
and CTS 111 is output from the differential output 
amplifier 114. A high-S/N signal free from any random 
noise or fixed-pattern noise of a pixel can be obtained. 

The horizontal scanning circuit 115 sequentially 
outputs scanning timing signals to the horizontal 
transfer MOS transistors of respective pixels to obtain 
outputs from the pixels. Outputs from all the pixels of 
the image sensor 10 can be similarly obtained under the 
control of the vertical scanning circuit 116 and 
horizontal scanning circuit 115. 

The operation flow of a camera having the image 
sensing element (image sensor) according to the 
preferred embodiment of the present invention will be 
described with reference to Fig. 9. 
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If the photographer turns on the main switch (not 
shown) of the digital still camera 1 (S200) , the CPU 20 
for controlling the overall camera executes focus 
detection of the image sensing lens 5 (S202) . The flow 
5 of focus detection calculation will be explained with 
reference to Fig. 10. 

The CPU 20 of the camera main body 1 sends an 
image sensing start signal for focus detection to the 
image sensor control circuit 21 to cause the image 

10 sensor 10 to sense a focus detection beam (S211) . 

The image sensor control circuit 21 A/D-converts 
an output from a light-receiving portion for condensing 
a beam having passed through one predetermined region on 
the pupil of the image sensing lens 5, out of the 

15 light-receiving portions of the image sensor 10 arranged 
on the prospective imaging plane of the image sensing 
lens 5. The converted signal is output to the CPU 20. 
Similarly, the image sensor control circuit 21 
A/D-converts an output from a light-receiving portion 

20 for condensing a beam having passed through the other 
predetermined region on the pupil of the image sensing 
lens 5. The converted signal is output to the CPU 20. 

From the signals output from the two focus 
detection light-receiving regions 119a and 119b of each 

25 of pixels having identical color filters, the CPU 20 
generates an object image by the focus detection beam 
having passed through one predetermined region on the 
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pupil of the image sensing lens 5, and an object image 
by the focus detection beam having passed through the 
other predetermined region on the pupil of the image 
sensing lens 5. Fig. 7 shows two object images (focus 
detection signals) obtained by the two focus detection 
light-receiving regions of each pixel. As shown in 
Fig. 4, the light-receiving regions 119a and 119b for 
receiving a focus detection beam on one pixel of the 
image sensor 10 are wide in the central region of the 
pixel in Fig. 4, and narrow in the peripheral region of 
the pixel. A beam incident on the light-receiving region 
119a and a beam incident on the light-receiving region 
119b are almost symmetrical to each other. Two generated 
object images exhibit high coincidence in correlation 
calculation, resulting in high focus detection precision. 
Even if the divided shape of one pixel of the image 
sensor 10 is changed into a shape prepared by cutting 
out the outer corners of the light-receiving regions 
119a and 119b in consideration of wiring at the 
peripheral portion of the pixel, as shown in Fig. 11, 
the received beam keeps the dotted shape in Fig. 4, not 
posing any problem. 

After two object images are detected, the CPU 20 
calculates the correlation by using the two object 
images. The defocus amount of the image sensing lens 5 
is calculated from the image shift amount of each image. 
Then, the CPU 20 returns to the flow shown in Fig. 9 
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(S212) . 

The CPU 20 sends a lens driving signal to the 
image sensing lens driving mechanism 26. The image 
sensing lens driving mechanism 26 drives the image 
sensing lens 5 by an amount corresponding to the defocus 
amount, and sets it to an in-focus state (S203) . 

After the image sensing lens 5 is driven to a 
predetermined position and focus adjustment ends (S203) , 
the CPU 20 of the camera main body 1 sends an image 
sensing signal to the image sensor control circuit 21 to 
cause the image sensor 10 to sense an image (S204) . At 
this time, charges generated in the light-receiving 
regions 119a, 119b, and 119c of the image sensor 10 are 
added up within the pixel, and the sum is output to the 
image sensor control circuit 21. An image signal sensed 
by the image sensor 10 is A/D-converted by the image 
sensor control circuit 21, and subjected to image 
processing by the image processing circuit 24. The image 
signal having undergone image processing is sent to the 
liquid crystal display element driving circuit 25 via 
the CPU 20, and displayed on the liquid crystal display 
element 9 (S205) . This allows the photographer to 
observe the object image displayed on the liquid crystal 
display element 9 via the eyepiece lens 3. 

The CPU 20 checks the state of the manipulation 
switch SW2 for recording a sensed image (S206) . If the 
photographer does not manipulate the manipulation switch 
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SW2 (NO in S206), the CPU 20 checks the state of the 
main switch (S201) . 

If the photographer presses the manipulation 
switch SW2 in order to photograph the object (YES in 
S206) , the CPU 20 sends an image sensing signal to the 
image sensor control circuit 21 to cause the image 
sensor 10 to perform actual image sensing (S207) . An 
image signal A/D-converted by the image sensor control 
circuit 21 undergoes image processing by the image 
processing circuit 24. The resultant image signal is 
sent to the liguid crystal display element driving 
circuit 25 and displayed on the liquid crystal display 
element 9 (S208) . 

At the same time, the CPU 20 directly stores the 
sensed image signal in the memory circuit 22 of the 
camera main body 1 (S209) . 

If photographing operation ends and the 
photographer turns off the main switch (YES in S201) , 
power supply to the camera stops to change the camera to 
a standby state (S210) . 

Focus detection is performed based on outputs from 
a plurality of lines in the embodiment, but may be done 
based on an output from one line. 

In the embodiment, the accumulation time of the 
focus detection light-receiving region is determined for 
each line on the basis of a monitoring output from the 
line. The accumulation time may be determined commonly 



for a plurality of lines by averaging monitoring outputs 
from the lines used for focus detection. 

In the embodiment, the vertical and horizontal 
scanning circuits are arranged as image sensor control 
5 circuits outside the image sensor. However, the vertical 
and horizontal scanning circuits may be incorporated in 
the image sensor. 

All or part of software in the embodiment may be 
replaced by hardware, or all or part of hardware in the 
10 embodiment may be replaced by software. 

Either all or part of the apparatus and method 
according to the embodiment can constitute the present 
invention . 

The apparatus and building components in the 
15 embodiment may be practiced as part of another apparatus 
or by coupling them to anther apparatus. 

The present invention can also be applied to 
various image sensing apparatuses such as a video movie 
camera, video still camera, interchangeable-lens camera, 
20 single-lens reflex camera, lens shutter camera, and 

monitoring camera, and further to apparatuses including 
these image sensing apparatuses. 

The functions of the embodiment can also be 
achieved by providing to a system or apparatus a storage 
25 medium (or recording medium) which records program codes 
of predetermined software. The functions of the 
embodiment can be realized not only when the computer 



executes the program codes stored in the storage medium, 
but also when the OS (Operating System) running on the 
computer performs part or all of actual processing on the 
basis of the instructions of the program codes. The 
functions of the embodiment are also realized when the 
program codes read out from the storage medium are 
written in the memory of a function expansion board 
inserted into the computer or the memory of a function 
expansion unit connected to the computer, and the CPU of 
the function expansion board or function expansion unit 
executes part or all of actual processing on the basis of 
the instructions of the program codes. 

The present invention realizes high-precision 
exposure control regardless of the F-number of an image 
sensing lens in photography. 

The preferred embodiment of the present invention 
can increase coincidence between two images subjected to 
correlation calculation in focus detection and increase 
the focus detection precision. 

The preferred embodiment of the present invention 
can obtain an image sensed under a proper exposure as an 
image subjected to correlation calculation in focus 
detection. 

As many apparently widely different embodiments of 
the present invention can be made without departing from 
the spirit and scope thereof, it is to be understood 
that the invention is not limited to the specific 
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embodiments thereof except as defined in the claims. 
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